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Considering Langevin dynamics we derive tlie general form of tlie stochastic differential that 
satisfies the Gallavotti-Cohen symmetry. This extends the work previously done by Kurchan, and 
Lebowitz and Spohn on such systems, and we treat systems with and without inertia in a unified 
manner. We further shown that for systems with a time-reversal invariant steady state there exists 
a stochastic difi'erential for which then the Gallavotti-Cohen symmetry, and all its consequences, 
are valid for finite times. For these systems the differential can be seen as the direct analogy of 
the Gibbs-entropy creation along paths in deterministic systems. It differs from previously studied 
differentials in that it identically zero for equilibrium systems while on average strictly positive for 
non-equilibrium system. When the steady state is not time reversal invariant the Gallavotti-Cohen 
symmetry is asymptotically valid in the usual long time limit. 

I. INTRODUCTION 

In closed and isolated Hamiltonian systems the Liouville theorem states that the volume of any phase-space 
element is invariant under the time evolution, i.e. the phase-space contraction rate, cr(q*,7r*), vanishes. If the 
system couples to the outside world this is in general no longer true. The phase-space contraction rate fluctuates 
along trajectories, and it has been shown [1, 4] that this rate can be interpreted as the Gibbs-cntropy creation 
rate. In [5] it was further shown that if a system satisfies the chaotic hypothesis [3, 4], then the probability 
distribution for the average phase-space contraction along a realisation, tr, satisfies 

Prob(o-) _ 1 



Prob(-g-) 



exp(Ta), dtaiq',TV*), T 



This relationship is called the fluctuation theorem and was initially observed in numerical simulations [2] . This 
led to the formulation of the chaotic hypothesis, which enabled a theoretical derivation of the above result 
(see [4] and references therein). This theorem is especially interesting since it is a parameter free prediction, 
valid arbitrarily far from equilibrium, concerning quantities with a potentially physical interpretation. The 
appreciation of its importance was further increased when it was realised [3] that it gives the fluctuation- 
dissipation theorem of equilibrium statistical mechanics in the linear regime around equilibrium. 

The fluctuation theorem can also be written as a symmetry relation of the moment-generating functional of 
the phase-space contraction along paths, and we follow [9] in referring to this as the Gallavotti-Cohen symmetry. 

We here consider stochastic systems evolving with Langevin dynamics. Even though stochastic systems have 
already been considered in this setting [8, 9, 11], we here slightly generalize the explicit derivations, and treat 
the systems under consideration in a unified manner. We further show that under certain circumstances we can 
define a stochastic differential that satisfies the fluctuation theorem for finite times. This stochastic differential 
is also shown to be on average strictly positive for non-equilibrium systems, while it vanishes identically for 
equilibrium systems. By analogy with the above mentioned situation for deterministic systems we therefore 
suggest identifying this stochastic differential with the Gibbs-entropy creation along a infinitesimal step of the 
evolution. 

In what follows we will explicitly examine the effect of time reversal on the level of path probability densities, 
and use this to derive the Gallavotti-Cohen symmetry. This puts the derivation for system with and without 
inertia on an equal footing. 

II. THE LANGEVIN PROCESS 



We consider a collection of fields, <j> — {(f>a} G S, evolving through the state space S with stochastic dynamics 
given by the Langevin equation 

ds0a = fa{(t>)At + Tai{<l))AsWi. (1) 

The differential dg is interpreted as a Stratonovich differential, which corresponds to the limit of a finite noise- 
correlation time approaching zero [13]. The index a is taken to be discrete, continuous, or mixed, and we 
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sum/integrate over repeated indexes. The noise term dsWi(t) is constructed from a standard, uncorrelated, 
Wiener process. Since the noise originates in another physical space (the heat reservoir) we choose to use Latin 
subscripts to enumerate its components. We further assume the noise-correlation matrix 

to be positive definite for all € S. For later reference we note that the Stratonovich interpretation gives the 
normal differential rule 

ds5'('A) = dag{(l>)ds(f>a, 



A. Time reversal 

Since one often models Hamiltonian systems connected to heat reservoirs with an equation like (1), we 
need to allow for degrees of freedom that transform under the reversal of the direction of time. Given that a 
Hamiltonian is an even function in the generalized momentums, Hamilton's equations are invariant under the 
time-reversal transformation 

t —t, q ^ q, TT ^ — TT. 

When coupling the Hamiltonian system to the external world, or when we consider coarse-grained degrees of 
freedom, we will no longer assume the dynamics to be time-reversal invariant. This because we have given 
up on a complete description of the system, and any time reversal that can be observed will only effect our 
coarse-grained degrees of freedom (^), and the driving. That is, we assume the stochastic effects of the noise 
to be invariant under time reversal. We now introduce a generalized time-reversal map 6 such that 

where 9af3{4>) '= dfjOaicf))- In what follows we will omit the field dependence of 6afj since it always corresponds 
to the filed dependence of the vector it is applied to. The effect of time reversal on the evolution equation is 

ds^a = fa{<f>)dt + Tai{(t>)dsWi 

Oa0{<l>)ds<P/3 = Mecf>){-dt) + T0i{ecj>){-d,Wi). 

Since the stochastic effect of the noise is taken to be time-reversal invariant, we require TaiiO^) = Oa0T0i{<p)- 
It is convenient to introduce the reversible and irreversible parts of any vector ha{<p) according to 

/ia(0) ='^(/ia(0) - e^phpiocp)), hi{cly)'':^'^{h^{cP) + e^phpi9<P)), 

which transform as 

With these definition the evolution equations take the form 

Original: d«.^„ = {/^{(j,) + fii4>))dt + T„i{<l>)d,Wi, 

Time reversed: d^^a = {fa{(t>) - /a(</>))di - rQ,j(^)dsWi, 

and we see that the equations of motion are time-reversal invariant only if fl^Tai = 0. 

B. The Fokker-Planck equation and an operator formalism 

Under the dynamics given by (1) a probability density, p, will evolve according to the Fokker-Planck equation, 

dtP{^, t) = ~daJa{<t), t), Ja{4>, t) = ka{4>)p{(l>, t) - di3{Sai3{4>)p{4>, t)), (2) 




3 



where ka{(l>) is a drift vector, given by 

kcc{ct>) = + ^Tp,{<f^)dpT^,i^). (3) 

Viewing (2) as a conservation equation for probability, we interpret Ja{4>,t) as the probabihty current through 
state space. Introducing the generahzed potential 

-lnp(0,i), 

we can also define the streaming velocity in phase space, ja((/>, f), through 

Ja{<l>,t) = jcc{(t>,t)p{(j),t), ja{^,t) = ka{(p) + Ea0{(f))dp^(j),t) - dpEa0{(f)). (4) 

Prom (2) and (4) it follows that 

dtiMt)) = -{ja{m,t)) = -{kaim))- 

Looking at (3), it is clear that the evolution of the averaged fields contain contributions from both deterministic 

and stochastic influences (c.f. the behaviour of a driven Brownian particle in an non-imiform temperature field). 

To facilitate the transition to a path-integral formalism we put the Fokker- Planck equation in a bra-ket 
notation. Assume that we have a Hilbert space, spanned by the orthonormal basis and having the 

usual quadratic norm. In this space we represent probability densities with 

and define the field operators and their canonical conjugates pa through 

^J^' [ d{.^}|0)0„(./>|, pj:^' [ d{<P}\<P)ld^{<P\. 

These operators satisfy the usual canonical commutator relation \pa,4>0\ = t5ai3- For the time reversed field 
operators we introduce the notation 

4>a = 0a4> and Pa = OfjaPH- 

Prom the above it directly follows that for a differentiable function, g{(j)), we have 

[Pa, g] = idaQ, \Pa, Q] = ^^afi')^ = lOpadp9, (5) 

where we have made use of the short hand notation g = g{^) and g = g{4')- In this operator notation the 
Pokker-Planck equation can conveniently be written as 

We also define the left vector 

which satisfies (OlSl = for all probability conserving evolution operators Cl. Using the operator notation we 
can write conditional probabilities as 

VYoh{(j)', t'\<l), t) = exp((t' - t)n)\(f)). (6) 

We arc interested in the Stratonovich interpretation of stochastic differentials, and it turns out to be advanta- 
geous to write operators in a symmetric fashion with respect to <j) and p. More precisely, we put any operator 
A = A{(p,p), which is a finite polynomial in p, in the form 

^ = S ^ • • •^«n<,...,a„('A) + <i,...,a„ WPai " " "Pan) + 

Tl=l 
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Here the quantities a"^ a^i^) ^'''^ independent of p, and can be calculated through the use of the com- 
mutator relationship (5). To simplify notation we use the above to introduce the ordering operation [-j^y^ 
through 



.n=l 

with the help of which the evolution operator can be written as 

, def 



dof 



A, 



sym 



Ct = Osym(<?^,p) 



(7) 



C. Detailed balance 



For a closed and isolated Hamiltonian system it can be shown that the transition probabilities and the 
steady-state (equilibrium) probability density, poj satisfy the detailed-balance condition [7, 14] 

Prob(<^',tV>i)Po(</>) = Prob(00,t'|^<^',t)po(0(/.'). (8) 

On the right hand side of the above we have implicitly time reversed all external quantities as well (such as 
external magnetic fields). The relationship (8) is a direct consequence of the time- reversal invariance exhibited 
by the equations of motion. Considering every order oit — t' in the operator representation (6), (8) is equivalent 
to 

Po = h, ^Po = Po^^- (9) 

The evolution equation we are considering is not in general time-reversal invariant, and thus such a system will 
in general not satisfy detailed balance. It was shown in [7, 14] that for a system like the one considered here, 
the detailed-balance condition is equivalent to the potential conditions 

$o(<^) = *o(^</'), Ji{^) = o, a„j^(</.)=o 

^ (10) 

M^) = M04>), i^(<^) = 0, (5„ - d^M^))jM = o, 

where we have used the generalized potential $o = — Inpo- The condition on the reversible current is always 
satisfied in a steady state, and thus the detailed-balance condition is equivalent to requiring the absence of any 
irreversible currents, and that the steady-state probability density is time-reversal invariant. 



III. THE GALLAVOTTI-COHEN SYMMETRY THROUGH PATH INTEGRALS 

In the proof of the fiuctuation theorem for thermostatted Hamiltonian systems [5] , time reversal played a 
crucial part in that it enabled the authors to write the phase-space contraction along a path in terms of the 

phase-space contraction along the corresponding time-reversed path. Following this in spirit, we will consider 
the effect of time reversal explicitly on the path probability densities, and see how it gives the Gallavotti-Cohen 
symmetry also for stochastic systems. 



A. Path integrals 

A path-integral formulation for the Langevin process was pioneered by Onsager and Machallup [10, 12] when 
considering a linear Langevin equation. We will derive a similar formulation for the fully non-linear case, but 
only push the derivations as far as will be needed in order to derive the Gallavotti-Cohen symmetry (for a full 
treatment see [6]). 

The system is assumed to be in a steady state with probability density pQ. Using the operator formalism 
introduced in the previous chapter we can move to a standard path-integral formalism, much in the same way 
as is done in quantum mechanics. We slice the time direction in intervals of size St and let tk = Stk. With the 
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help of (6), we write the probabihty density of a discrete sampUng, (f)st{-) = {<P{ti),<p{t2), ■ ■ ■ ,'f>{tT/st))j of the 
reahzation as 



Pvoh{<i>st{-)) = 



T/6t-l 

H {ct>{tk+i)\ex.p{Stn)\ct>{tk)) 
fe=o 



exp(-$o(<^(0))). 



Since we have expressed the evolution operator in a symmetric form (7) it simpUfies considerations if we first 
consider a general expression of the type 



{(j) + S(l)\ exp St a{(f))b{p) + c{(l)) 



sym 



+ 5,^\ exp ( 5t ( i(a(<^)6(p) + ci^))\ ) exp (st (^(6(p)a(0) + c(0)) 



Inserting the identity operator (as represented in the eigenbasis of p) between the two exponentials, we can 
write the above as 

(*) = J d{p} exp (^-i5<l>„PaSt + Q(a((/> + Scj)) + a{4>))h{p) + ^(c((/> + (5(/>) + c(0)) 

Recalling that our stochastic differential equation (1) gives rise to paths for which 5(j) = 0{Vsi), we have 

(*) = J d{p} exp (-2(50ap„ + St (a(^)&(p) + c(^))) + Oidt^), 4> = (j> + (5(/./2. 
Using this, and the symmetric form of the evolution operator (7), we can write 

{(l> + 5(i)\e^^{5t(l)\(l))= J d{p}ex.p{-SS{^,p)) +0{St''), (11) 
where the dynamical-action difference 6S{(j),p) is given by 

5S{(i>,p) = ipa6(pa - Qsym{4',p)St. 

Since the action is quadratic in p wo could perform the integration over p and then take the limit St \ 0. To 
do this one has to take special care of terms divergent as St \ 0, and this is done in [6]. Wc do not require this 
form of the action in subsequent derivations, and do not pursue this matter further. The above formulation 
shows the advantages of using a symmetric representation of the evolution operator when considering stochastic 
differentials of the Stratonovich type. 

When studying the effect of time reversal, we are faced with a further complication due to the possibility 
that the steady-state probability density is not time-reversal invariant. To account for this fact we split the 
generalised potential into two parts, 

$o(0) = $f (0) + A$o(</'), 
where we demand the reference potential to be time-reversal invariant 

Considering the time-reversed path (f)st{-) = 6(j)st{T — ■) we can write the path probability density for the 
time-reversed realisations as 



Prob(<^5t(-)) 



T/St-l 

{e<t>{tk)\eM5tmH{tk+i)) 

fe=0 



exp(-$o(00(r))) 



T/SL-l 



n (0(tfe+i)| exp(5t exp(-4.-f)fi^ exp($-'))|</.(tfc)) 



fe=0 



exp(-A$o(0'/'(T)) + A$o(0(O)) - $o(0(O))). 
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In the above we have used the time- reversal invariance of <I>q''^ in order to bring it inside the product. In the 
case of a system with a time-symmetric steady state we can choose A<l>o = 0, and the surface terms vanishes, 
while in the general case we can never eliminate the surface terms all together. Introducing the operator 

^($) n _ exp(-$)i7t exp(l>), 

we can rewrite the above path probability density as 



T/St-l 
fc=0 



exp(-A$o + A^oWO)) - $o(</'(0))). 



Through taking the symmetric representation of both (7) and (t(<E>q°'), 



sym 



and using the same path-integral techniques as before, each term in the above product can be written as 



/ 



d{p} exp(-(<55(0,p) + 6tai4>,p))), 



(12) 



with 



Through the variable change 

which does not effect the measure d{p}, we can put (12) in the form 



exp(-(5a(^)) / d{p}eM-5S{^,p)) 



(13) 



where 



5c7{<l>) = {k'M) - {d, - d^%^'{^))E^,{cl>))E-'^{cl>){Scl>0 - k^{^)St) - (9„ - d^%^' {<!>)) k^{cl>) St. 



ref / 



We have hereby eliminated the p dependence from Sa, which therefore is well defined as a stochastic difference 
along the evolution of paths. Defining the (irreversible) vector 

and taking the limit St\0, we replace the symbol 6 with the differential symbol ds, and get 

dM^) = gfrn-'^mdscPfsY - (da - d„%'^'{mw. (14) 

In the above we have defined the irreversible and reversible field differentials 

{d,4>,,Y=[fl{4>)dt + rMd,w, 

(d,,^„)« '^'/,?(0)dt, (note that /^(</.) = k^{^)), 
which transform under time reversal according to 

{d,cj>c.y ^ -{dsCPaY, {d^cPaf ^ {d^cPaf. 

We further note that the first term in the above split up (14) is irreversible while the second term is reversible. 
For the total cr-creation along a path 0(-) = lim^jx^o 0(5t(O) 



a[</.(-)] = / d^m) 

Jt=o 
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it now follows from (11) and (13) that, 

crim = In + A$o(0(O)) - A<l>o(<^(0)), a[^(.)] = -a[<^(.)]. (15) 

Thus wo sec that the probability density for time reflected paths arc related through a simple integration of 
a differential along the paths. This will later directly give the Gallavotti-Cohen symmetry. We here also note 
that a change in reference potential ^o**^ ~* ^o**^ + adds the differential of the extra potential function to the 
cr-differential, 

dsCT((?i) ^dsCT((A) + ds*((A). 

It is interesting to view (14) in the light of the potential conditions (10). Considering the conditions for a 
system to exhibit detailed balance with respect to the generalized potential $0*^^, we have 

jl{<l>) = 0, {d^ - d^^'^')k^{<i>) = 0. 

If one further notes that in this case we have g^^^ = j^, then the direct link between the cr-creation and 
the breaking of the detailed-balance condition on the level of the individual paths becomes explicit. On the 
operator level this is also seen by the fact that the detailed balance condition (9) gives a{^^Q^) = 0. We further 
see that the non-vanishing of the irreversible and reversible terms in the a-creation originate in breaking the 
detailed-balance condition for the irreversible and reversible currents respectively. 



B. The Gallavotti-Cohen symmetry 

The Gallavotti-Cohen symmetry is a symmetry of the moment generating functional of cr[0(-)], 

e(A)''=l'-iln(exp(-Aa[<^(.)])). (16) 
This can be put in the operator language by defining the operator L\ as 

{(j)'\Lx\(l)) = (exp (^->'J^ dcr{(j){t))j)4,{o)=4', 4>W=<t>'' 

where the average is over paths evolving for a time 1, given the initial and final values indicated in the subscript. 

Any other finite time interval could have been chosen, but we use this as it gives the simplest notation. The 
moment generating functional of cr[(^(-)] can now be written as, 

e(A) = -lln(0|ir|0). (17) 

Equivalently, since there is a unique time reversed realization corresponding to every realization, we could have 
taken the average over the time reversed ensemble. Using (15), the moment generating functional can thus be 
written as 

e(A) = -iln(0|exp(-A$o(<^))irAexp(A$o(<^))|0). (18) 

If the steady state is time symmetric we can choose A$o = 0, and then equation (17) and (18) directly give 
the Gallavotti-Cohen symmetry, 

e(A) =e(l-A). 

In contrast to previously derived versions of this symmetry the above is valid for any finite time T. 

If, on the other hand, the steady-state probability density is not time-reversal invariant, we can only show 
the above under certain assumptions on the dynamics and in the long time limit. To this end we assume 
that the dynamics is such that there is a unique, real maximal eigenvalue i'max(A), corresponding to a positive 
eigenvector of Lx (in the finite and fully connected phase space this would be guaranteed by Perron- Probenius 
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theorem). First considering the average in the form (17), we note that since the maximal eigenvector is positive, 
there is always a non-zero overlap with both (0| and |0). Thus 

e(A) = -w(A)+0(l/r). 

We could as well have considered (18), giving 

e(A) = -w(l-A) + (!?(l/T). 

Combining these two results we directly get the Gallavotti-Cohen symmetry in the long time limit, 

e(A) = e(l-A)+C(l/T). 



C. The fluctuation theorem 



We here illustrate the connection between the Gallavotti-Cohen symmetry and the fluctuation theorem in 

the case where we can choose A^o = 0. The situation is again more comphcated for a system with a time 
asymmetric steady state, but is covered by the discussion in [9] . Denoting the average cr-creation over the time 
interval [0, T] by a, we use (16) to rewrite the probability density over a as 

//'IOC 1 
I?(/.(-)Prob[<^(-)]5(Ta - a[ct>{-)]) = j ^ exp(r(sa - e(s))) 

= / exp(r(sa - e(l - s))) = ejip(Ta)Pvoh{-a), 

J -zoo 27ri 

which is a version of the fluctuation theorem that is exact for flnite T. 



IV. THE (7-CREATION IN TWO SPECIAL CASES 



Below we will study the form of (14) for general systems with time-reversal invariant steady-state probability 
densities, as well as for a Hamiltonian system coupled to a non-uniform heat reservoir and driven by non- 
potential forces. In the latter case we can no longer assume the steady-state probability densities to be time- 
reversal invariant. 

In both cases we need to choose the appropriate reference potential, $q®^. We shall try to make the simplest 
choice possible, but also remember that we ultimately want to consider an analogy between (14) and the phase- 
space contraction rate for deterministic systems. Thus we would like the cr-differcntial to vanish when the 
steady state is approaching an equilibrium steady state. Therefor we require $q°' = $o in equilibrium. 



A. Systems with time-reversal invariant steady states 



As has been shown above, the Gallavotti-Cohen theorem can be satisfied for finite times as soon the steady- 
state probability density is time-reversal invariant. For a general steady state the reversible and irreversible 
currents must both be divergence free, 

daJl{ct>) = d^J^{4>) = 0. 

Demanding that the steady state is time-reversal invariant, and making the simplest choice ^'q^ = we have, 

This results in that only the irreversible part of the cr-creation contributes 
Prom this it follows that 

(d,a(</.)) = (ji(0)S-i(</.)4(0))dt. 
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Since wc have assumed the noise-correlation matrix to be positive definite the above is always non-negative, 
and only vanishes in equilibrium. Thus, since the differential dgcr satisfies the fluctuation theorem, vanishes for 
equilibrium systems, and is on average strictly non-negative in a non-equilibrium steady state, we identify this 
as corresponding to the phase-space contraction rate in the deterministic (see introduction), and therefore also 
as the Gibbs-entropy creation rate. It further satisfies the fluctuation theorem for flnite times. 
In the next section we consider a important example when it is not possible to choose A$o = 0. 



B. A Langevin system with inertia 

In this section we show how the general form (14) directly recreates the results previously derived by ansatz 
in [9] . It further points to the significance played by the Hamiltonian over temperature as a reference potential. 
We consider a Hamiltonian system coupled to a heat bath of inverse temperature P{q), and with the Hamiltonian 

H{q,TT) = ^iz--K + V{q). 

We further assume the system to be influenced by a non-potential driving force f^^^'^iq), and a viscous drag 
—7(9)77. The fields are taken to evolve according to the Langevin equation 

where we have introduced an small noise term in the q-differential in order to keep the noise-correlation matrix 
non-singular. We will keep e finite for now, but set it to zero at the end. The specific form of the stochastic 
force acting on the generalized-momentum coordinates is chosen to given the equilibrium steady state 

Peq(Q,7r) oc exp(-/3il(q, tt)), 

in the absence of any drive and temperature gradient. The reversible and irreversible drifts become 



For general position dependent (3{q) and with an (non-potential) drive present, the steady-state potential is in 
general not timc-rcversal invariant. We then have to chose some other reference potential. The most natural 
choice seems to be the equilibrium potential, and this is indeed the choice that recreates the results of [8, 9]. 
So, using 

$f(q,7r)=/3(g)W(9,7r) and 3(9, tt) = (^'/^ ^^^^^^^^^ 
we have 

d,<7(0) = 0{e) + (3{q) (^H{q, 7r)^MM + /driva(g^^ . ^^t. (19) 

It is now safe to take the limit e \ 0, and contrary to the situation for the systems with a time-reversal invariant 
steady-state probability density, all the cr-creation is reversible. 

Since the steady state is not time symmetric, the Gallavotti-Cohen symmetry and the fluctuation theorem 
are asymptotically valid only in the long-time limit. It further follows that the cr-creation integrated along the 
paths and averaged over histories is asymptotically non- negative as one considers longer and longer times [9]. 
Equation (19) is the same result as in [8, 9], while it is re-derived here to illustrate that it is contained in the 
general form (14). It further underlines the difference in choice of reference potential compared with the case 
where the system displays a time-symmetric steady state. 

In [9] the above differential (19) was interpreted as work done on the system by the driving force and the 
temperature gradient, divided by temperature. 
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V. CONCLUSION 

For general Langevin systems we have derived a general form (14) of the stochastic differential that satisfies 
the Gallavotti-Cohcn symmetry. This was done by considering the effect of time reversal on the path probability 
densities generated by the dynamics. 

In the general form (14) we have introduced a time-reversal symmetric reference potential $ref- In the case 
when the dynamics gives rise to a time-symmetric steady state, we can choose <l>i.cf = $oi ^^^d the cr-creation 
satisfies the fluctuation theorem for finite times. It also vanished along every path for equilibrium systems, 
while being on average strictly positive for non-equilibrium systems. By analogy with deterministic systems we 
thus identify / dsfT(^(f)) as the Gibbs-entropy creation along the path ^{t). 

We also considered the special case of a Hamiltonian system with an non-uniform temperature field, and 
driven by a non-potential force. Here the steady-state probability density can not be assumed time-reversal 
invariant, and a different reference potential has to be chosen. By considering the Hamiltonian over temperature 
as the reference potential, we were able to recreate previous results [8, 9], giving a differential that also can be 
interpreted as some form of entropy production. 
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